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TSP  -  A  World-Class  Development  Practice 
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[1]  Software  Engineering 
Best  Practices,  by  Capers 
Jones,  2010. 
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Team  Software  Process 


The  Team  Software  Process  (TSP) 
is  a  process  framework  that  was 
initially  designed  for  software  teams. 

It’s  purpose  is  to  help  teams  achieve 
their  best  performance  by  showing 
them  how  to 

•  accurately  estimate  and  plan 
their  work 

•  negotiate  their  commitments 
with  management 

•  manage  and  track  projects  to  a 
successful  conclusion 

•  manage  quality  to  produce  better 
products  in  less  time 
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TSP  -  No  Longer  “Just  for  Software” 


Even  from  it’s  earliest  pilot  projects,  TSP  was  used  by  integrated 
project  teams  that  included  various  domain  experts. 

•  electronic  and  mechanical  engineers 

•  system  engineers 

•  test  engineers 

•  business  analysts 

•  technical  writers 

•  game  and  graphic  designers 


In  recent  years,  TSP  has  been  adapted  for  use  by  non-software 
knowledge-working  teams. 

•  process  groups 

•  nuclear  engineers 

•  systems  &  test  engineers 

•  IT  services 
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Organizations  Using  TSP 
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Intuit 
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Adobe 


Vicarious 

Visions' 


microsystems 


Advanced  Information  Services,  Inc. 

Beckman  Coulter 

Bursatec 

Cadence 

Centro  De  Investigacion  En  Matamaticas 
Chinasoft  International,  Inc. 

Computing  Technologies,  Inc. 

Davis  Systems 

DEK  International  GmbH 

Delaware  Software,  S.A.  de  C.V. 

Delivery  Excellence 

Grupo  Empresarial  Eisei,  S.A.  de  C.V. 

Herbert  Consulting 

Hitachi  Software  Engineering  Co.,  Ltd. 

Idea  Entity  Corp. 

InnerWorkings,  Inc. 

Instituto  Tecnologico  y  de  Estudios  Superiores  de 
Monterrey 


Johannesburg  Centre  for  Software  Engineering 
Kernel  Technologies  Group,  S.A.  de  CV 
Knowldege  Partner  QR  Pvt.  Ltd. 

Kyushu  Institute  of  Technology 
L.  G.  Electronics 
LogiCare 
Motiva,  LLC 

National  Aeronautics  &  Space  Administration 
Nedbank 

Next  Process  Institute  Ltd. 

Praxis  High  Integrity  Systems 
Process  &  Project  Health  Services 
Procesix 

PS&J  Consulting  -  Software  Six  Sigma 
QuarkSoft 

Sandia  National  Laboratories 
Science  Applications  International  Corporation 
Seontis 


Siemens  AG 

SILAC  Ingenieria  de  Software  S.A.  de  C.V. 
SKIZCorp  Technology 

Software  Engineering  Competence  Center  (SECC) 
Software  Park  Thailand 
STPP,  Inc. 

TOWA  INTEGRADADORA  S.A.  de  C.V. 

TRX 

Universidad  Autonoma  De  Zacatecas 
Universidad  de  Monterrey 
Universidad  Regiomotana  A.C. 

University  of  Aizu 

U.S.  Air  Force  (CRSIP/STSC) 

U.S.  Census  Bureau 

U.S.  Navy  Air  Systems  Command  (NAVAIR) 

U.S.  Naval  Oceanographic  Office  (NAVO) 

Urban  Science 
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Project  Settings  Where  TSP  Has  Been  Applied 


Project  Team 
Characteristic 

Experience 

Team  Size 

From  two  to  twenty  team  members  per  team  and  multi-team  projects  up  to 
100+  developers 

Team  Location 

Co-located,  geographically  distributed,  and  even  multi-team  settings  with 
more  than  one  organization  participating. 

Work  Domain 

Software  engineering,  hardware  teams,  systems  engineering,  nuclear 
engineering,  and  IT  services. 

Multi-discipline 

Integrated  teams  consisting  of  many  disciplines  such  as  software,  hardware, 
test  and  quality  assurance,  business  analysts,  architects,  game  developers, 
artists,  documentation  specialists,  and  other  engineering  disciplines. 

Project  Duration 

Very  short  projects  of  a  few  weeks  duration  up  to  projects  lasting  a  few  years. 

Development 

Strategies 

Mostly  incremental  or  iterative  development  with  periodic  internal  and 
external  releases.  Cycle  or  sprint  length  ranging  from  a  few  weeks  to  a  few 
months. 

New  systems,  enhancements  to  existing  systems,  including  very  large  legacy 

Project  Mode 

systems,  pure  maintenance,  prototyping,  system  feasibility,  system  proposal 
teams,  and  projects  or  groups  providing  on-going  and  request-based  services. 
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Scalability 


Capers  Jones  ranked  TSP  as  the  best  software  engineering  practice  for 
medium  and  large  applications  and  a  close  second  for  small  applications. 
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Reported  Benefits 


Microsoft  IT 

> 

Microsoft 

•  Mean  schedule  error  reduced  from  10%  to  1% 

v 

•  Substantially  reduced  post-code  complete  defects 

J 

/ 

Jntuit 

V _  _ _ 

Intuit 

•  QuickBooks  post-release  defects  reduced  by  60% 

•  Functionality  delivered  increased  by  30% 

_ J 

M 

Adobe 

v  ^ 

Adobe 

•  Four  times  less  rework  on  TSP  teams 

•  Adoption  of  TSP  is  a  great  way  for  teams  to  improve  both  quality  and  productivity 

W 

s 

\ 

Oracle 

•  7  fold  improvement  in  quality 

V  ^  / 

•  System  Test  cycle  effort  reduced  by  90% 

J 

c 

AS  Vicarious 
Mk  Visions" 

V 

\ 

Vicarious  Visions 

•  “TSP  helped  us  meet  schedule  while  addressing  a  zero-defect  quality  objective” 

J 
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Knowledge  Work 


“The  key  rule  in  managing  knowledge  work 
is  this:  managers  can’t  manage  it,  the 
workers  must  manage  themselves.” 

Software  development  is  knowledge  work. 

To  manage  software  work,  developers  must 

•  be  motivated 

•  make  accurate  plans 

•  negotiate  commitments 

•  track  their  plans 

•  manage  quality 

How  is  this  accomplished? 
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SE 


Watts  Humphrey, 
creator  of  TSP 


Technologies  Forum  Twitter:  #SEIVirtualForum 


Personal  Software  Process  (PSP) 


PSP  Course 

PSP  Level 

Focus 

PSPO 

Basic  method 

Metrics 

PSP  1 

Planning 

Estimating 

Tracking 

PSP  2 

Design 

Quality  management 

PSP  skills  are  the  foundations  of  TSP. 

PSP  training  introduces  team  skills 
using  a  progressive  model. 

Developers  try  new  practices  and  learn 
from  their  results. 


13  Defect  Fix  Time  by  Type   n  x 


Defect  Fix  Time  by  Type 


3Total  Cost  of  Quality  _  H  X 

Total  Cost  of  Quality 

#  ,0 

I  3. 

-a  A"' 

> 

° 

h” 
» ... 

/  v 

/ 

/ 

( 

I  *oo  »oi  *«  l£5L*t®2k*  *05  *oe  «ot  1 

Program  ID 

3Time  Estimating  Error 


Time  Estimating  Error 


7 


HI  Total  Defects  _  H  X 

Total  Defects 

Q 

Q 

/  V  ♦ 

^ 

400  401  402  403  404  405  406  407 

Program  ID 

-  Software  Engineering  Institute 


Carnegie  Mellon 


©  201 1  Carnegie  Mellon  SEI  Technologies  Forum  Twitter:  #SEIVirtualForum 
University 


The  TSP/PSP  Measurement  Framework 


Schedule 


Size 


Quality 


Effort 


Source:  CMU/SEI-92-TR-019 


Four  direct  measures  apply 
to  all  processes  and 
products. 

•estimates  are  made  during 
planning 

•measures  are  recorded  by 
developers  while  working 

The  data  are  used  to  track 
project  status  and  to  analyze 
and  improve  performance. 


Benefit  -  direct  measures, 
integrated  into  a 
measurement  framework, 
provide  flexibility. 
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Team  Management  Styles 


Customer  or 
Representative 


Management 


Traditional  team 

The  leader  plans,  directs,  and  tracks  the 

work. 


TSP  Self-directed  team 

The  team  plans,  directs,  and  tracks  their 

work. 
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The  TSP  Coaching  Role 


The  coach 

•  trains  and  facilitates  the 
adoption  of  TSP 

•  works  with  the  team  leader  to 
build  the  team 

•  observer  that  guides  the  team 

Team  Leader  vs.  Coach 

The  team  leader’s  job  is  to  use  the  team 
to  build  the  product. 

The  coach’s  job  is  to  use  the  project  to 
build  the  team. 
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Rapid  Deployment  Strategy 


TSP  is  implemented  project-by-project. 

•  Select  two  or  three  teams. 

•  Train  top-down,  starting  with  senior 
managers,  then  project  managers,  then 
team  members. 

•  When  the  managers  and  team  are 
trained,  conduct  a  TSP  Launch  to  kick¬ 
off  each  project. 

•  Evaluate  and  fine  tune  the  approach. 

•  Repeat  this  cycle  increasing  scope  at  a 
sustainable  pace. 
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TSP  Training  Courses 


TSP  Executive  Strategy  Seminar 

•  Building  a  “winning”  organization 

•  Managing  with  facts  and  data 

•  One-day  course 


Leading  a  Development  Team 

•  Building  self-directed  teams 

•  Motivating  and  leading  self-directed  teams 

•  Three-day  course 


A 


LEADERSHIP. 
TEAMWORK,  J 
AND  TRUST/ 


Building  a  Competitive 
Software  Capability 


Watts  $  Humphriy  Iamis  W  Ovit 


TSP 


Coaching  Development  Teams 

•  Launching  Teams 

•  Coaching  teams 

•  Five-day  course 


PSP  for  Software  Developers 

•  Using  a  defined  and  measured  personal 
process 

•  Planning,  tracking,  design,  quality 
management 

•  Five-day  course 
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TSP  is  Agile  -  Plus 


Features  TSP  and  Agile  Methodologies  Support 


Agile 


TSP 


Team  organization 

Project  management  -  planning  and  estimating 

Change  control 

Requirements 

Design 

Code  development 
Configuration  control 
Testing 


Software  Engineering  Best  Practices,  C.  Jones,  2010 


Team  organization 

Project  management  -  planning  and  estimating 

Change  control 

Requirements 

Design 

Code  development 
Configuration  control 
Testing 

Specialization  of  team  members 

Project  management  -  tracking  and  control 

Reusability 

Quality  assurance 

Inspections 

Static  analysis 

Security 

Documentation  and  training 
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Quality  Management  is  Critical 


Jeff  Sutherland,  inventor  of  SCRUM,  recently  wrote  online  of  the  need 
for  “intolerance  of  defects”  in  managing  product  backlog.  But  how? 

From  data  on  over  40  TSP  teams,  Intuit  found  that 

•  post  code-complete  effort  was  8%  instead  of  33%  of  the  project 

•  for  TSP  projects,  standard  test  times  were  cut  from  4  months  to  1  week 

•  most  TSP  teams  included  some  agile  practices  in  their  team  processes 

Testing  time  was  reduced  from  four  months  to  one  month. 


Non-TSP 


TSP 

Diagram  and  Data:  Intuit 


Development 


Development 


Test 
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CMMI  and  TSP 


CMMI  is  a  model  that  describes 
many  of  the  best  practices  for 
development. 

•  about  “what”  not  “how-to” 

•  an  improvement  roadmap 

•  a  capability  benchmark 


Software  Engineering  Institute 


Carnegie  Mellon 


TSP  is  a  process  that  integrates 
many  CMMI  best  practices. 

•  about  “how-to”  not  “what” 

•  an  improvement  tool 

•  a  performance  benchmark 
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Accelerated  Improvement  Method  (AIM) 

Integrates  and  Leverages  Effective  Improvement  Technologies 
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A  Challenging  Project 


Background: 

•  Bolsa  Mexicana  de  Valores  (BMV)  operates 
the  Mexican  financial  markets  under  license 
from  the  federal  government. 

•  Bursatec  is  the  technology  arm  of  the  BMV. 

•  BMV  desired  a  new  trading  engine  to 
replace  the  existing  stock  market  engine 
and  integrate  the  options  and  futures 
markets. 

•  The  BMV  performed  a  build  vs.  buy 
analysis,  and  decided  to  replace  their  three 
existing  trading  engines  with  one  in-house 
developed  system. 

Approach: 


•  Build  the  right  system  (SEI  Architecture) 


•  Build  the  right  way  (SEI  TSP) 


-  Software  Engineering  Institute 


Carnegie  Mellon 


©  201 1  Carnegie  Mellon  SEI  Technologies  Forum  Twitter:  #SEIVirtualForum 
University 


Challenging  Project’s  Results 


A  key  TSP  principle: 


Doing  it  the  right  way  is,  in  the  long  run,  always  faster  and  cheaper : 

•  On  time  (21  months  of  development  including  5  major  milestones) 

•  Slightly  under  budget  (14-17  developers  including  architects,  no  use  of 
contingency) 

•  Few  defects  (tests  ongoing  but  <  50  actual  defects  to  date  in  200,000+  LOC) 

•  ALL  key  quality  attributes  achieved  (main  latency  requirement  exceeded  by 
factor  of  10);  extra  functionality  implemented 

•  NO  SURPRISES!  NO  FIRE-DRILLS!  (project  was  transparent  both 
technically  and  from  the  Project  Office  view) 

•  Very  low  turnover  (1  from  project,  1  after  leaving  the  project) 
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Summary 


TSP  -  the  Team  Software  Process 

•  is  a  robust,  agile  project  and  quality  management  framework 

•  is  for  project  teams  up  to  1 00  or  more 

•  has  world-class,  quantified,  published  results 

•  has  proven,  repeatable  methods  for  training,  introduction,  and 
coaching 

TSP  projects  successfully  integrate  other  best  practices,  including 

•  most  agile  methods,  including  many  elements  of  SCRUM  and  XP 

•  RUP  and  most  other  lifecycle  methodologies 

•  Six  Sigma 

•  CMMI  at  all  maturity  levels 

•  SEI  architecture  and  secure  coding  practices 
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Contact  Information 


James  McHale 

Sr.  Member  of  the  Technical  Staff 
TSP  Initiative 

Telephone:  +1  412-268-3948 
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